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(54) Device and method for voice activity detection 



(57) The invention relates to a device, a mobile ap- 
paratus incorporating the device, an accessory there- 
fore and a method for voice activity detection, particu- 
larly in a mobile telephone, using the directional sensi- 
tivity of a microphone system and exploiting the knowl- 
edge about the voice source's orientation in space. The 
device comprises a sound signal analyser arranged to 



determine whether a sound signal comprises speech. 
According to the invention, the device further comprises 
a microphone system (2a£to2.c t 2G l 2e) arranged to dis- 
criminate sounds emanating from sources located in dif- 
ferent directions from the microphone system, so that 
sounds only emanating from a range of directions are 
included as signals possibly containing speech. 
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Description 

Field of the invention 

[0001] The present invention relates to a device, a 
mobile apparatus incorporating the device, an accesso- 
ry therefor and a method for voice activity detection, par- 
ticularly in a mobile telephone, using the directional sen- 
sitivity of a microphone system and exploiting the knowl- 
edge about the voice source's orientation in space. The 
device assists the existing voice activity detection to 
achieve higher sensitivity and requiring less processor 
power. 

State of the art 

[0002] Voice activity detectors are used e.g. in mobile 
phones to enhance the performance in certain situa- 
tions. The most common way to construct a voice activ- 
ity detector is to look at the levels of the sub-bands of 
the incoming signal. Then the background noise level 
and the speech level are estimated and compared with 
a threshold to determine whether speech is present or 
not. An example of a voice activity detector is disclosed 
in U.S. patent 6,427 ? 134. 

[0003] For instance in noisy environments it is hard to 
make a uniform parameter set-up for the voice activity 
detector. Therefore several voice activity detectors are 
needed, trimmed to the specific cases. For example in 
some modules you need to be sure that if there is 
speech it should be detected (echo canceller), but in oth- 
er cases it is better to indicate no speech if the signal to 
noise ratio level is too low. The plurality of voice activity 
detectors put a load on the digital signal processors that 
have to take care of performing the various voice activity 
detection algorithms. 

Summary of the invention 

[0004] An object of the present invention is to comple- 
ment existing voice activity detection taking into account 
the direction of the source of the sound. 
[0005] In a first aspect, the invention provides a de- 
vice for voice activity detection comprising a sound sig- 
nal analyser arranged to determine whether a sound 
signal comprises speech. 

[0006] According to the invention, the device further 
comprises 

a microphone system arranged to discriminate sounds 
emanating from sources located in different directions 
from the microphone system, so that sounds only ema- 
nating from a range of directions are included as signals 
possibly containing speech. 

[0007] Suitably, the range of directions is directed in 
the direction of an intended user's mouth. 
[0008] In one embodiment, the microphone system 
comprises two microphone elements separated a dis- 
tance and located on a line directed in the direction of 



an intended user's mouth. 

[0009] The range of directions may be defined as all 
sounds falling inside a cone with a cone angle a : where- 
in 10°<a<30°, and preferably, a is approximately 25°. 
5 [0010] In another embodiment, the microphone sys- 
tem comprises three microphone elements separated a 
distance and located in a plane directed in the direction 
of an intended user's mouth. 

[0011] Suitably, two of said three microphone ele- 
10 ments are separated a distance and located on a line 
directed perpendicular to the direction of an intended us- 
er's mouth. 

[0012] In another embodiment, the microphone sys- 
tem comprises four microphone elements located such 
15 that the fourth microphone is not located in the same 
plane as the three others. 

[0013] The microphone elements may be directional 
with a pattern having maximal sensitivity in the direction 
of an intended user's mouth. 

20 [0014] In still a further embodiment, the microphone 
system comprises one directional microphone element 
together with one or more other microphone elements 
to remove the uncertainty in the direction of the sound 
source. The directional microphone element may be 

25 used to measure the sound pressure level relative to the 
other microphone element. 

[0015] In a second aspect, the invention provides a 
mobile apparatus comprising a device as mentioned 
above. 

30 [001 6] Suitably, the microphone elements are located 
at the lower edge of the apparatus. 
[0017] In one embodiment, a plurality of microphone 
elements are located at the lower edge of the apparatus 
and at least one further microphone element is located 

35 at a distance from the lower edge. 

[0018] The mobile apparatus may be a mobile radio 
terminal, e.g. a mobile telephone, a pager, a communi- 
cator, an electric organiser or a smartphone. 
[0019] In a third aspect, the invention provides an ac- 

40 cessory for a mobile apparatus comprising a micro- 
phone system as mentioned above. 
[0020] Suitably, the direction of the range of directions 
is adjustable. 

[0021 ] The accessory may be a hands-free kit or a tel- 
45 ephone conference microphone. 

[0022] In a fourth aspect, the invention provides a 
method for voice activity detection, including the steps 
of: 

so receiving sound signals from a microphone system 
arranged to discriminate sounds emanating from 
sources located in different directions from the mi- 
crophone system; 

determining the direction of the sound source caus- 
55 ing the sound signals; 

if the sounds emanate from a first range of direc- 
tions, further analyse 

the sound to determine whether the sound signal 
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comprises speech; 

but if the sounds emanate from a second, different 
range of directions decide that the sound signal 
does not comprise speech. 

[0023] Suitably, the first range of directions is directed 
in the direction of an intended user's mouth. 
[0024] The first range of directions may be defined as 
all sounds falling inside cone with a cone angle a, 
wherein 10°<a<30°, and preferably a is approximately 
25°. 

[0025] In one embodiment, the microphone system 
comprises at least two microphone elements located at 
a distance from each other and located on a line directed 
in the direction of an intended user's mouth, said two 
microphone elements being separated a distance d, 
wherein the direction to the sound source e is calculated 
as 

Af-v 

G = arccos -^j 

where 

At is the time difference between the sounds from the 
two microphone elements, 
v is the velocity of sound. 

[0026] In another embodiment, one directional micro- 
phone element is used together with one or more other 
microphone elements to remove the uncertainty in the 
direction of the sound source. 

[0027] The directional microphone element may be 
used to measure the sound pressure level relative to the 
other microphone element. 

[0028] The invention is defined in the attached inde- 
pendent claims 1, 12, 16, and 20, while preferred em- 
bodiments are set forth in the dependent claims. 

Brief description of the drawings 

[0029] The invention will be described below in great- 
er detail with reference to the accompanying drawings, 
in which: 

fig. 1 is a perspective view of a mobile phone incor- 
porating the present invention, and 
fig. 2 is a schematic drawing of the receiving angle 
of an embodiment of the present invention. 

Detailed description of preferred embodiments 

[0030] As mentioned briefly in the introduction, many 
signal processing algorithms, such as echo cancellation 
and background noise synthesis, used in phones and 
hands-free kits are based on the fact that the user is 
speaking or not. For example the speech codec is active 
when the near-end user is speaking and the background 
synthesis is active when the near-end user is silent. All 
these algorithms need good voice activity detectors 



(VAD) to perform well. An error in the detection can re- 
sult in artefacts or malfunctions caused by divergence 
of the algorithms or other problems. 
[0031] Existing voice activity detectors are directed to 

5 determine whether speech is present or not in a sound 
signal. However, in fact not all speech is interesting or 
relevant, but only the user's speech. All other speech, 
e.g. in a noisy environment with several persons speak- 
ing, could be ignored and regarded as just noise. 

10 [0032] The present inventor has realised that a micro- 
phone system having some kind of directional sensitivity 
could be used to discriminate sound emanating from dif- 
ferent sources located in different directions. Sound not 
emanating from the user can be declared as non- 

15 speech, and those signals do not have to be analysed 
with the conventional voice activity detectors. 
[0033] The existing voice activity detectors may be 
conventional and are only referred to as a sound signal 
analyser in this application. 

20 [0034] Generally, a microphone system having some 
kind of directional sensitivity can be used. Fig. 1 shows 
an example with at least two separate microphone ele- 
ments. 

[0035] A general mobile telephone is indicated at 1 . 

25 The invention is equally applicable to other devices such 
as mobile radio terminals, pagers, communicators, elec- 
tric organisers or smartphones. The common feature is 
that voice activity detection is employed, e.g. in connec- 
tion with communicating speech or receiving voice com- 

30 mands by means of speech recognition. 

[0036] In the simplest version, the microphone sys- 
tem comprises two microphones 2a and 2b. Suitably, 
they are located on a line directed in the calculated di- 
rection of an intended user's mouth. Suitably the micro- 

35 phone elements are located at the lower edge of the mo- 
bile apparatus 1 . 

[0037] Fig. 2 shows a schematic diagram of the cal- 
culation of the direction of the sound source, typically 
the user's mouth 3. In the case of two microphones, only 

40 the angle to the line on which the microphone elements 
are located can be determined. In other words, the di- 
rection of the sound source is on a cone with a cone 
angle 6. To calculate the angle 0, first a cross-correlation 
between the two signals from the microphones 2a and 

45 2b is made. The maximum indicates the time difference 
At between the two microphones 2a and 2b. The dis- 
tance between the two microphones 2a and 2b is e.g. 
20 millimetres. The angle 0 is calculated as 

so Af -v 

e = arccos 7 

[0038] Note that arccos is only defined for arguments 
between — 1 and 1. If the time difference is negative, 
55 this means that the angle is greater than 90° and the 
sound emanates from behind the apparatus. 
[0039] Suitably, the device is adapted to determine 
that all sounds with an angle G less than a fixed angle a 
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are emanating from the user. The threshold angle a may 
be set within a range of e.g. 10° to 30°, suitably at 25°. 
[0040] In the case of three microphones, the direction 
of the sound source can be further determined to be at 
two points (e.g. on the above cone). The three micro- s 
phone elements are suitably located in a plane directed 
in the general direction of the user's mouth. In fig. 1 mi- 
crophone elements 2b , 2c and 2d are a possible set-up. 
The two microphone elements 2c and 2d at the front are 
located on a line perpendicular to the direction of the 10 
user's mouth, while the third microphone element 2b is 
located at the rear side. 

[0041 J In the case of four microphones (or more) de- 
tection of all direction angles may be calculated, provid- 
ed that four microphone elements are located such that is 
the fourth microphone is not located in the same plane 
as the three others, e.g. on a tetrahedron. A possible 
set-up is two microphone elements 2c and 2d at the front 
on the lower edge, while a third microphone element 2b 
is located at the rear side, and a fourth microphone el- 20 
ement 2e is located at the front at a distance from the 
lower edge. 

[0042] A similar microphone arrangement may be 
used in an accessory to a mobile apparatus, such as a 
hands-free kit or a telephone conference microphone 25 
system intended to be placed on a table. Apart from the 
microphone elements the logic circuitry may be located 
in the main/mobile apparatus. In this case the reception 
angle of the microphone system can be adjustable. This 
is useful e.g. when the microphone system is placed in 30 
a car, where the user can be seated either in the driver's 
seat or in the passenger's seat or even both the driver 
and the passenger may be speakers during the same 
call. The adjustment of the reception angle can be 
achieved mechanically or electronically, for example by 35 
beam forming or adaptation of the directional sensitivity 
of the microphone system. 

[0043] To further enhance the sensitivity of the micro- 
phone system, directional microphone elements with a 
pattern having a maximum sensitivity in the direction of *o 
the user's mouth could be used. 
[0044] In a further embodiment, one directional micro- 
phone element is used together with one or two other 
microphone elements (that may be non-directional). 
The directional microphone element is used to measure 
the sound pressure level relative to the other(s), thus 
removing the uncertainty in the direction of the sound 
source. Various combinations of directional microphone 
elements and non-directional microphone elements are 
possible. 50 
[0045] The present invention leads to a voice activity 
detector having enhanced performance. With the 
present invention only one voice activity detector may 
be necessary throughout the whole signal path. This will 
in turn reduce the computational complexity, decreasing 55 
the load on the digital signal processors as well as im- 
proving the performance. It is especially favourable in 
environments with high background noise and noise 



with similar spectral properties as speech. 
[0046] A person skilled in the art will realise that the 
invention may be realised with various combinations of 
hardware and software. The scope of the invention is 
only limited by the claims below. 



Claims 

1. A device for voice activity detection comprising a 
sound signal analyser arranged to determine 
whether a sound signal comprises speech, charac- 
terised by 

a microphone system (2a, 2b, 2c, 2d : 2e) arranged 
to discriminate sounds emanating from sources lo- 
cated in different directions from the microphone 
system, so that sounds only emanating from a 
range of directions are included as signals possibly 
containing speech. 

2. A device according to claim 1 , characterised in 
that the range of directions is directed in the direc- 
tion of an intended user's mouth (3). 

3. A device according to claim 2, characterised in 
that the microphone system comprises two micro- 
phone elements (2a, 2b) separated a distance and 
located on a line directed in the direction of an in- 
tended user's mouth (3). 

4. A device according to claim 3, characterised in 
that the range of directions is defined as all sounds 
falling inside a cone with a cone angle a, wherein 
10°<a<30°. 

5. A device according to claim 3, characterised in 
that a is approximately 25°. 

6. A device according to claim 2, characterised in 
that the microphone system comprises three micro- 
phone elements (2b, 2c, 2d) separated a distance 
and located in a plane directed in the direction of an 
intended user's mouth (3). 

7. A device according to claim 6, characterised in 
that two (2c, 2d) of said three microphone elements 
are separated a distance and located on a line di- 
rected perpendicular to the direction of an intended 
user's mouth (3). 

8. A device according to claim 2, characterised in 
that the microphone system comprises four micro- 
phone elements (2b, 2c, 2d, 2e), located such that 
the fourth microphone (2e) is not located in the 
same plane as the three others (2b, 2c, 2d). 

9. A device according to any one of claims 1 to 8, char- 
acterised in that the microphone elements (2a, 2b, 
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2c, 2d, 2e) are directional with a pattern having 
maximal sensitivity in the direction of an intended 
user's mouth (3). 

10. A device according to claim 1, characterised in 5 
that the microphone system comprises one direc- 
tional microphone element together with one or 
more other microphone elements adapted to re- 
move the uncertainty in the direction of the sound 
source. 10 

11. A device according to claims 10, characterised in 
that the directional microphone element is adapted 
to measure the sound pressure level relative to the 
other microphone element. 15 

12. A mobile apparatus, characterised in that it com- 
prises a device as defined in any one of claims 1 to 
11. 

20 

13. A mobile apparatus according to claim 12, charac- 
terised in that the microphone elements (2a, 2b, 
2c, 2d) are located at the lower edge of the appa- 
ratus. 

25 

14. A mobile apparatus according to claim 12, charac- 
terised in that a plurality of microphone elements 
(2a, 2b, 2c, 2d) are located at the lower edge of the 
apparatus and at least one further microphone ele- 
ment (2e) is located at a distance from the lower 30 
edge. 

15. A mobile apparatus according to any one of claims 
12 to 14, characterised in that it is a mobile radio 
terminal, e.g. a mobile telephone (1), a pager, a 35 
communicator, an electric organiser or a smart- 
phone. 

16. An accessory for a mobile apparatus, character- 
ised in that it comprises a microphone system (2a, *o 
2b, 2c, 2d, 2e) as defined in any one of claims 1 to 

11. 

17. An accessory according to claim 16, characterised 

in that the direction of the range of directions is ad- «5 
justable. 

18. An accessory according to claim 16 or 17, charac- 
terised in that it is a hands-free kit. 

50 

19. An accessory according to claim 16 or 17, charac- 
terised in that it is a telephone conference micro- 
phone. 

20. A method for voice activity detection, character- 55 
ised by the steps of: 

receiving sound signals from a microphone 



system (2a, 2b, 2c, 2d, 2e) arranged to discrim- 
inate sounds emanating from sources located 
in different directions from the microphone sys- 
tem; 

determining the direction of the sound source 
causing the sound signals; 
if the sounds emanate from a first range of di- 
rections, further analyse the sound to deter- 
mine whether the sound signal comprises 
speech; 

but if the sounds emanate from a second, dif- 
ferent range of directions decide that the sound 
signal does not comprise speech. 

21. A method according to claim 20, characterised in 
that the first range of directions is directed in the 
direction of an intended users mouth (3). 

22. A method according to claims 21 , characterised in 
that the first range of directions is defined as all 
sounds falling inside a cone with a cone angle a, 
wherein 10°<a<30°. 

23. A method according to claims 22, characterised in 
that a is approximately 25°. 

24. A method according to any one of claims 22 or 23, 
characterised in that the microphone system com- 
prises at least two microphone elements (2a, 2b) 
located at a distance from each other and located 
on a line directed in the direction of an intended us- 
er's mouth (3), said two microphone elements being 
separated a distance d, wherein the direction to the 
sound source 6 is calculated as 

Af-v 

G = arccos - ^ 

where 

At is the time difference between the sounds from 
the two microphone elements, 
v is the velocity of sound. 

25. A method according to claims 20, characterised in 
that one directional microphone element is used to- 
gether with one or more other microphone elements 
to remove the uncertainty in the direction of the 
sound source. 

26. A method according to claims 25, characterised in 
that the directional microphone element is used to 
measure the sound pressure level relative to the 
other microphone element. 



5 



RMRDOCID: <EP 



EP 1 489 596 A1 




6 



EP 1 489 596 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 03 44 5076 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (MLCL7) 



Y 
Y 



US 2003/027600 Al (0RAINTARA S00T0RN ET 
AL) 6 February 2003 (2003-02-06) 

paragraph [O0O6] * 

* paragraph [0017] * 

paragraph [0022] * 
idem 



US 2002/009203 Al (ERTEN GAMZE) 
24 January 2002 (2002-01-24) 

* figures 2,4 * 

* paragraph [0009] * 

* paragraphs [0044] , [0045] * 

* figures 9,12 * 

EP 1 206 161 A (SONY JNTERNAT EUR0P GMBH) 
15 May 2002 (2002-05-15) 

* abstract * 

*, sentence 40 - sentence 44 * 

* paragraph [0021] * 

* paragraphs [0027] , [0028] * 

* figures 2,3 * 



I, 2,9, 

II, 12, 
20,21,251 



3,6-8, 
16-19 



G10L11/02 

H04R3/0O 

H04R1/4O 



16-19 
6-8 



TECHNICAL FIELDS 
SEARCHED <lnt.Cl.7) 



G10L 
H04R 



The present search report has been drawn up tor all claims 



Place of search 

MUNICH 



Cale d completion of the search 

10 October 2003 



Examiner 

Krembel , L 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken atone 

Y : particularly relevant if combined with another 

document of the same category 
A : technological background 
O : non-written disclosure 
P : intermediate document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on, or 

after the filing date 
D : document cited in the application 
L : document crted for other reasons 

& : member of the same patent family, corresponding 
document 



7 



PMcnnr.in <rPP 



1489596A1 1 > 



EP 1 489 596 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 03 44 5076 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned European search report. 
The members are as contained in the European Patent Office EDP file on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 

10-10-2003 



Patent document 


Publication 


Patent family 


Publication 


cited in search report 


date 


member(s) 


date 



US 2003827600 Al 
US 2002009203 Al 



06-G2-2003 NONE 



24-G1-2O02 AU 
CA 
CN 
EP 
W0 



5121301 A 
2404071 Al 
1436436 T 
1295507 A2 
0176319 A2 



EP 1206161 



15-G5-2002 EP 



1206161 Al 



15-10-2001 
11-10-2001 
13-08-2003 
26-03-2003 
11-10-2001 



15-O5-2002 



S For more details about this annex : see Official Journal of the European Patent Office, No. 12/82 



QMcnnrm- ,t:o 



